Dataset statistics
| Number of variables | 10 |
|---|---|
| Number of observations | 889 |
| Missing cells | 0 |
| Missing cells (%) | 0.0% |
| Duplicate rows | 0 |
| Duplicate rows (%) | 0.0% |
| Total size in memory | 62.6 KiB |
| Average record size in memory | 72.1 B |
Variable types
| Numeric | 6 |
|---|---|
| Categorical | 4 |
df_index is highly correlated with PassengerId | High correlation |
PassengerId is highly correlated with df_index | High correlation |
Survived is highly correlated with Sex | High correlation |
Pclass is highly correlated with Fare | High correlation |
Sex is highly correlated with Survived | High correlation |
Fare is highly correlated with Pclass | High correlation |
df_index is highly correlated with PassengerId | High correlation |
PassengerId is highly correlated with df_index | High correlation |
Survived is highly correlated with Sex | High correlation |
Pclass is highly correlated with Fare | High correlation |
Sex is highly correlated with Survived | High correlation |
Fare is highly correlated with Pclass | High correlation |
df_index is highly correlated with PassengerId | High correlation |
PassengerId is highly correlated with df_index | High correlation |
Survived is highly correlated with Sex | High correlation |
Pclass is highly correlated with Fare | High correlation |
Sex is highly correlated with Survived | High correlation |
Fare is highly correlated with Pclass | High correlation |
Sex is highly correlated with Survived | High correlation |
Survived is highly correlated with Sex | High correlation |
df_index is highly correlated with PassengerId | High correlation |
PassengerId is highly correlated with df_index | High correlation |
Survived is highly correlated with Sex | High correlation |
Pclass is highly correlated with Fare and 1 other fields | High correlation |
Sex is highly correlated with Survived | High correlation |
SibSp is highly correlated with Parch and 1 other fields | High correlation |
Parch is highly correlated with SibSp | High correlation |
Fare is highly correlated with Pclass and 1 other fields | High correlation |
Embarked is highly correlated with Pclass | High correlation |
df_index is uniformly distributed | Uniform |
PassengerId is uniformly distributed | Uniform |
df_index has unique values | Unique |
PassengerId has unique values | Unique |
SibSp has 606 (68.2%) zeros | Zeros |
Parch has 676 (76.0%) zeros | Zeros |
Fare has 15 (1.7%) zeros | Zeros |
Reproduction
| Analysis started | 2021-12-13 14:54:21.125725 |
|---|---|
| Analysis finished | 2021-12-13 14:54:35.915198 |
| Duration | 14.79 seconds |
| Software version | pandas-profiling v3.1.0 |
| Download configuration | config.json |
df_index
Real number (ℝ≥0)
HIGH CORRELATIONHIGH CORRELATIONHIGH CORRELATIONHIGH CORRELATIONUNIFORMUNIQUE| Distinct | 889 |
|---|---|
| Distinct (%) | 100.0% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 445 |
| Minimum | 0 |
|---|---|
| Maximum | 890 |
| Zeros | 1 |
| Zeros (%) | 0.1% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 7.1 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 44.4 |
| Q1 | 223 |
| median | 445 |
| Q3 | 667 |
| 95-th percentile | 845.6 |
| Maximum | 890 |
| Range | 890 |
| Interquartile range (IQR) | 444 |
Descriptive statistics
| Standard deviation | 256.9981728 |
|---|---|
| Coefficient of variation (CV) | 0.5775239838 |
| Kurtosis | -1.197156422 |
| Mean | 445 |
| Median Absolute Deviation (MAD) | 222 |
| Skewness | 0 |
| Sum | 395605 |
| Variance | 66048.06081 |
| Monotonicity | Strictly increasing |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 0 | 1 | 0.1% |
| 598 | 1 | 0.1% |
| 587 | 1 | 0.1% |
| 588 | 1 | 0.1% |
| 589 | 1 | 0.1% |
| 590 | 1 | 0.1% |
| 591 | 1 | 0.1% |
| 592 | 1 | 0.1% |
| 593 | 1 | 0.1% |
| 594 | 1 | 0.1% |
| Other values (879) | 879 |
| Value | Count | Frequency (%) |
| 0 | 1 | |
| 1 | 1 | |
| 2 | 1 | |
| 3 | 1 | |
| 4 | 1 | |
| 5 | 1 | |
| 6 | 1 | |
| 7 | 1 | |
| 8 | 1 | |
| 9 | 1 |
| Value | Count | Frequency (%) |
| 890 | 1 | |
| 889 | 1 | |
| 888 | 1 | |
| 887 | 1 | |
| 886 | 1 | |
| 885 | 1 | |
| 884 | 1 | |
| 883 | 1 | |
| 882 | 1 | |
| 881 | 1 |
PassengerId
Real number (ℝ≥0)
HIGH CORRELATIONHIGH CORRELATIONHIGH CORRELATIONHIGH CORRELATIONUNIFORMUNIQUE| Distinct | 889 |
|---|---|
| Distinct (%) | 100.0% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 446 |
| Minimum | 1 |
|---|---|
| Maximum | 891 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 7.1 KiB |
Quantile statistics
| Minimum | 1 |
|---|---|
| 5-th percentile | 45.4 |
| Q1 | 224 |
| median | 446 |
| Q3 | 668 |
| 95-th percentile | 846.6 |
| Maximum | 891 |
| Range | 890 |
| Interquartile range (IQR) | 444 |
Descriptive statistics
| Standard deviation | 256.9981728 |
|---|---|
| Coefficient of variation (CV) | 0.5762290869 |
| Kurtosis | -1.197156422 |
| Mean | 446 |
| Median Absolute Deviation (MAD) | 222 |
| Skewness | 0 |
| Sum | 396494 |
| Variance | 66048.06081 |
| Monotonicity | Strictly increasing |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 1 | 1 | 0.1% |
| 599 | 1 | 0.1% |
| 588 | 1 | 0.1% |
| 589 | 1 | 0.1% |
| 590 | 1 | 0.1% |
| 591 | 1 | 0.1% |
| 592 | 1 | 0.1% |
| 593 | 1 | 0.1% |
| 594 | 1 | 0.1% |
| 595 | 1 | 0.1% |
| Other values (879) | 879 |
| Value | Count | Frequency (%) |
| 1 | 1 | |
| 2 | 1 | |
| 3 | 1 | |
| 4 | 1 | |
| 5 | 1 | |
| 6 | 1 | |
| 7 | 1 | |
| 8 | 1 | |
| 9 | 1 | |
| 10 | 1 |
| Value | Count | Frequency (%) |
| 891 | 1 | |
| 890 | 1 | |
| 889 | 1 | |
| 888 | 1 | |
| 887 | 1 | |
| 886 | 1 | |
| 885 | 1 | |
| 884 | 1 | |
| 883 | 1 | |
| 882 | 1 |
| Distinct | 2 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 50.5 KiB |
| 0 | |
|---|---|
| 1 |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Characters and Unicode
| Total characters | 0 |
|---|---|
| Distinct characters | 0 |
| Distinct categories | 0 ? |
| Distinct scripts | 0 ? |
| Distinct blocks | 0 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 0 |
|---|---|
| 2nd row | 1 |
| 3rd row | 1 |
| 4th row | 1 |
| 5th row | 0 |
Common Values
| Value | Count | Frequency (%) |
| 0 | 549 | |
| 1 | 340 |
Length
Histogram of lengths of the category
Pie chart
| Value | Count | Frequency (%) |
| 0 | 549 | |
| 1 | 340 |
Most occurring characters
| Value | Count | Frequency (%) |
| No values found. | ||
Most occurring categories
| Value | Count | Frequency (%) |
| No values found. | ||
Most frequent character per category
Most occurring scripts
| Value | Count | Frequency (%) |
| No values found. | ||
Most frequent character per script
Most occurring blocks
| Value | Count | Frequency (%) |
| No values found. | ||
Most frequent character per block
| Distinct | 3 |
|---|---|
| Distinct (%) | 0.3% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 50.5 KiB |
| 3 | |
|---|---|
| 1 | |
| 2 |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Characters and Unicode
| Total characters | 0 |
|---|---|
| Distinct characters | 0 |
| Distinct categories | 0 ? |
| Distinct scripts | 0 ? |
| Distinct blocks | 0 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 3 |
|---|---|
| 2nd row | 1 |
| 3rd row | 3 |
| 4th row | 1 |
| 5th row | 3 |
Common Values
| Value | Count | Frequency (%) |
| 3 | 491 | |
| 1 | 214 | |
| 2 | 184 | 20.7% |
Length
Histogram of lengths of the category
Pie chart
| Value | Count | Frequency (%) |
| 3 | 491 | |
| 1 | 214 | |
| 2 | 184 | 20.7% |
Most occurring characters
| Value | Count | Frequency (%) |
| No values found. | ||
Most occurring categories
| Value | Count | Frequency (%) |
| No values found. | ||
Most frequent character per category
Most occurring scripts
| Value | Count | Frequency (%) |
| No values found. | ||
Most frequent character per script
Most occurring blocks
| Value | Count | Frequency (%) |
| No values found. | ||
Most frequent character per block
| Distinct | 2 |
|---|---|
| Distinct (%) | 0.2% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 50.5 KiB |
| 1 | |
|---|---|
| 0 |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Characters and Unicode
| Total characters | 0 |
|---|---|
| Distinct characters | 0 |
| Distinct categories | 0 ? |
| Distinct scripts | 0 ? |
| Distinct blocks | 0 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 1 |
|---|---|
| 2nd row | 0 |
| 3rd row | 0 |
| 4th row | 0 |
| 5th row | 1 |
Common Values
| Value | Count | Frequency (%) |
| 1 | 577 | |
| 0 | 312 |
Length
Histogram of lengths of the category
Pie chart
| Value | Count | Frequency (%) |
| 1 | 577 | |
| 0 | 312 |
Most occurring characters
| Value | Count | Frequency (%) |
| No values found. | ||
Most occurring categories
| Value | Count | Frequency (%) |
| No values found. | ||
Most frequent character per category
Most occurring scripts
| Value | Count | Frequency (%) |
| No values found. | ||
Most frequent character per script
Most occurring blocks
| Value | Count | Frequency (%) |
| No values found. | ||
Most frequent character per block
Age
Real number (ℝ≥0)
| Distinct | 88 |
|---|---|
| Distinct (%) | 9.9% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 29.31515186 |
| Minimum | 0.42 |
|---|---|
| Maximum | 80 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 7.1 KiB |
Quantile statistics
| Minimum | 0.42 |
|---|---|
| 5-th percentile | 6 |
| Q1 | 22 |
| median | 28 |
| Q3 | 35 |
| 95-th percentile | 54 |
| Maximum | 80 |
| Range | 79.58 |
| Interquartile range (IQR) | 13 |
Descriptive statistics
| Standard deviation | 12.98493229 |
|---|---|
| Coefficient of variation (CV) | 0.4429426925 |
| Kurtosis | 1.007819813 |
| Mean | 29.31515186 |
| Median Absolute Deviation (MAD) | 6 |
| Skewness | 0.5080100783 |
| Sum | 26061.17 |
| Variance | 168.6084667 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 28 | 202 | |
| 24 | 30 | 3.4% |
| 22 | 27 | 3.0% |
| 18 | 26 | 2.9% |
| 19 | 25 | 2.8% |
| 30 | 25 | 2.8% |
| 21 | 24 | 2.7% |
| 25 | 23 | 2.6% |
| 36 | 22 | 2.5% |
| 29 | 20 | 2.2% |
| Other values (78) | 465 |
| Value | Count | Frequency (%) |
| 0.42 | 1 | 0.1% |
| 0.67 | 1 | 0.1% |
| 0.75 | 2 | 0.2% |
| 0.83 | 2 | 0.2% |
| 0.92 | 1 | 0.1% |
| 1 | 7 | |
| 2 | 10 | |
| 3 | 6 | |
| 4 | 10 | |
| 5 | 4 | 0.4% |
| Value | Count | Frequency (%) |
| 80 | 1 | 0.1% |
| 74 | 1 | 0.1% |
| 71 | 2 | |
| 70.5 | 1 | 0.1% |
| 70 | 2 | |
| 66 | 1 | 0.1% |
| 65 | 3 | |
| 64 | 2 | |
| 63 | 2 | |
| 62 | 3 |
| Distinct | 7 |
|---|---|
| Distinct (%) | 0.8% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.5241844769 |
| Minimum | 0 |
|---|---|
| Maximum | 8 |
| Zeros | 606 |
| Zeros (%) | 68.2% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 7.1 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 1 |
| 95-th percentile | 3 |
| Maximum | 8 |
| Range | 8 |
| Interquartile range (IQR) | 1 |
Descriptive statistics
| Standard deviation | 1.103704876 |
|---|---|
| Coefficient of variation (CV) | 2.105565739 |
| Kurtosis | 17.83897238 |
| Mean | 0.5241844769 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 3.691057631 |
| Sum | 466 |
| Variance | 1.218164452 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=7)
| Value | Count | Frequency (%) |
| 0 | 606 | |
| 1 | 209 | 23.5% |
| 2 | 28 | 3.1% |
| 4 | 18 | 2.0% |
| 3 | 16 | 1.8% |
| 8 | 7 | 0.8% |
| 5 | 5 | 0.6% |
| Value | Count | Frequency (%) |
| 0 | 606 | |
| 1 | 209 | 23.5% |
| 2 | 28 | 3.1% |
| 3 | 16 | 1.8% |
| 4 | 18 | 2.0% |
| 5 | 5 | 0.6% |
| 8 | 7 | 0.8% |
| Value | Count | Frequency (%) |
| 8 | 7 | 0.8% |
| 5 | 5 | 0.6% |
| 4 | 18 | 2.0% |
| 3 | 16 | 1.8% |
| 2 | 28 | 3.1% |
| 1 | 209 | 23.5% |
| 0 | 606 |
| Distinct | 7 |
|---|---|
| Distinct (%) | 0.8% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.3824521935 |
| Minimum | 0 |
|---|---|
| Maximum | 6 |
| Zeros | 676 |
| Zeros (%) | 76.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 7.1 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 0 |
| 95-th percentile | 2 |
| Maximum | 6 |
| Range | 6 |
| Interquartile range (IQR) | 0 |
Descriptive statistics
| Standard deviation | 0.8067607445 |
|---|---|
| Coefficient of variation (CV) | 2.109442064 |
| Kurtosis | 9.750591706 |
| Mean | 0.3824521935 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 2.745160126 |
| Sum | 340 |
| Variance | 0.6508628989 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=7)
| Value | Count | Frequency (%) |
| 0 | 676 | |
| 1 | 118 | 13.3% |
| 2 | 80 | 9.0% |
| 5 | 5 | 0.6% |
| 3 | 5 | 0.6% |
| 4 | 4 | 0.4% |
| 6 | 1 | 0.1% |
| Value | Count | Frequency (%) |
| 0 | 676 | |
| 1 | 118 | 13.3% |
| 2 | 80 | 9.0% |
| 3 | 5 | 0.6% |
| 4 | 4 | 0.4% |
| 5 | 5 | 0.6% |
| 6 | 1 | 0.1% |
| Value | Count | Frequency (%) |
| 6 | 1 | 0.1% |
| 5 | 5 | 0.6% |
| 4 | 4 | 0.4% |
| 3 | 5 | 0.6% |
| 2 | 80 | 9.0% |
| 1 | 118 | 13.3% |
| 0 | 676 |
| Distinct | 247 |
|---|---|
| Distinct (%) | 27.8% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 32.09668088 |
| Minimum | 0 |
|---|---|
| Maximum | 512.3292 |
| Zeros | 15 |
| Zeros (%) | 1.7% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 7.1 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 7.225 |
| Q1 | 7.8958 |
| median | 14.4542 |
| Q3 | 31 |
| 95-th percentile | 112.31832 |
| Maximum | 512.3292 |
| Range | 512.3292 |
| Interquartile range (IQR) | 23.1042 |
Descriptive statistics
| Standard deviation | 49.69750432 |
|---|---|
| Coefficient of variation (CV) | 1.548368958 |
| Kurtosis | 33.50847727 |
| Mean | 32.09668088 |
| Median Absolute Deviation (MAD) | 6.9042 |
| Skewness | 4.801440211 |
| Sum | 28533.9493 |
| Variance | 2469.841935 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 8.05 | 43 | 4.8% |
| 13 | 42 | 4.7% |
| 7.8958 | 38 | 4.3% |
| 7.75 | 34 | 3.8% |
| 26 | 31 | 3.5% |
| 10.5 | 24 | 2.7% |
| 7.925 | 18 | 2.0% |
| 7.775 | 16 | 1.8% |
| 7.2292 | 15 | 1.7% |
| 26.55 | 15 | 1.7% |
| Other values (237) | 613 |
| Value | Count | Frequency (%) |
| 0 | 15 | |
| 4.0125 | 1 | 0.1% |
| 5 | 1 | 0.1% |
| 6.2375 | 1 | 0.1% |
| 6.4375 | 1 | 0.1% |
| 6.45 | 1 | 0.1% |
| 6.4958 | 2 | 0.2% |
| 6.75 | 2 | 0.2% |
| 6.8583 | 1 | 0.1% |
| 6.95 | 1 | 0.1% |
| Value | Count | Frequency (%) |
| 512.3292 | 3 | |
| 263 | 4 | |
| 262.375 | 2 | |
| 247.5208 | 2 | |
| 227.525 | 4 | |
| 221.7792 | 1 | 0.1% |
| 211.5 | 1 | 0.1% |
| 211.3375 | 3 | |
| 164.8667 | 2 | |
| 153.4625 | 3 |
| Distinct | 3 |
|---|---|
| Distinct (%) | 0.3% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Memory size | 50.5 KiB |
| 2 | |
|---|---|
| 0 | |
| 1 |
Length
| Max length | 1 |
|---|---|
| Median length | 1 |
| Mean length | 1 |
| Min length | 1 |
Characters and Unicode
| Total characters | 0 |
|---|---|
| Distinct characters | 0 |
| Distinct categories | 0 ? |
| Distinct scripts | 0 ? |
| Distinct blocks | 0 ? |
The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.
Unique
| Unique | 0 ? |
|---|---|
| Unique (%) | 0.0% |
Sample
| 1st row | 2 |
|---|---|
| 2nd row | 0 |
| 3rd row | 2 |
| 4th row | 2 |
| 5th row | 2 |
Common Values
| Value | Count | Frequency (%) |
| 2 | 644 | |
| 0 | 168 | 18.9% |
| 1 | 77 | 8.7% |
Length
Histogram of lengths of the category
Pie chart
| Value | Count | Frequency (%) |
| 2 | 644 | |
| 0 | 168 | 18.9% |
| 1 | 77 | 8.7% |
Most occurring characters
| Value | Count | Frequency (%) |
| No values found. | ||
Most occurring categories
| Value | Count | Frequency (%) |
| No values found. | ||
Most frequent character per category
Most occurring scripts
| Value | Count | Frequency (%) |
| No values found. | ||
Most frequent character per script
Most occurring blocks
| Value | Count | Frequency (%) |
| No values found. | ||
Most frequent character per block
Spearman's ρ
The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.
Pearson's r
The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.
Kendall's τ
Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.
Cramér's V (φc)
Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.Phik (φk)
Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here. A simple visualization of nullity by column.
Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.
First rows
| df_index | PassengerId | Survived | Pclass | Sex | Age | SibSp | Parch | Fare | Embarked | |
|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 0 | 1 | 0 | 3 | 1 | 22.000 | 1 | 0 | 7.250 | 2 |
| 1 | 1 | 2 | 1 | 1 | 0 | 38.000 | 1 | 0 | 71.283 | 0 |
| 2 | 2 | 3 | 1 | 3 | 0 | 26.000 | 0 | 0 | 7.925 | 2 |
| 3 | 3 | 4 | 1 | 1 | 0 | 35.000 | 1 | 0 | 53.100 | 2 |
| 4 | 4 | 5 | 0 | 3 | 1 | 35.000 | 0 | 0 | 8.050 | 2 |
| 5 | 5 | 6 | 0 | 3 | 1 | 28.000 | 0 | 0 | 8.458 | 1 |
| 6 | 6 | 7 | 0 | 1 | 1 | 54.000 | 0 | 0 | 51.862 | 2 |
| 7 | 7 | 8 | 0 | 3 | 1 | 2.000 | 3 | 1 | 21.075 | 2 |
| 8 | 8 | 9 | 1 | 3 | 0 | 27.000 | 0 | 2 | 11.133 | 2 |
| 9 | 9 | 10 | 1 | 2 | 0 | 14.000 | 1 | 0 | 30.071 | 0 |
Last rows
| df_index | PassengerId | Survived | Pclass | Sex | Age | SibSp | Parch | Fare | Embarked | |
|---|---|---|---|---|---|---|---|---|---|---|
| 879 | 881 | 882 | 0 | 3 | 1 | 33.000 | 0 | 0 | 7.896 | 2 |
| 880 | 882 | 883 | 0 | 3 | 0 | 22.000 | 0 | 0 | 10.517 | 2 |
| 881 | 883 | 884 | 0 | 2 | 1 | 28.000 | 0 | 0 | 10.500 | 2 |
| 882 | 884 | 885 | 0 | 3 | 1 | 25.000 | 0 | 0 | 7.050 | 2 |
| 883 | 885 | 886 | 0 | 3 | 0 | 39.000 | 0 | 5 | 29.125 | 1 |
| 884 | 886 | 887 | 0 | 2 | 1 | 27.000 | 0 | 0 | 13.000 | 2 |
| 885 | 887 | 888 | 1 | 1 | 0 | 19.000 | 0 | 0 | 30.000 | 2 |
| 886 | 888 | 889 | 0 | 3 | 0 | 28.000 | 1 | 2 | 23.450 | 2 |
| 887 | 889 | 890 | 1 | 1 | 1 | 26.000 | 0 | 0 | 30.000 | 0 |
| 888 | 890 | 891 | 0 | 3 | 1 | 32.000 | 0 | 0 | 7.750 | 1 |